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ABSTRACT 

The goal of the East Texas State University 
Elementary Secondary Education Act (ESEA) Title VII Bilingual 
Education Project was to improve the education of limited, and 
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masters and doctoral programs). This eight year project (1976-1984) 
was evaluated annually both internally and externally. The processes 
were monitored, student progress charted, and participant perceptions 
measured annually and compared longitudinally. This final report 
contains 1983-84 information, an evaluation of the entire project, 
and a brief presentation of the follow-up survey of almost 400 former 
program participants. Some took only a course or two as needed, some 
completed only certificate requirements, and 129 completed degree 
programs. The East Texas State University Bilingual training project 
was very successful in institutionalizing the project into its 
regular system. Students viewed the program as worthwhile, and were, 
generally, successful in gaining their degrees, certificates, and the 
abilities necessary to teach bilingually and in English as a second 
language. The annual student evaluation form and the participant 
follow-up survey questionnaire are appended. (BS) 
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The civil rights movement, federal legislation, and court cases on the education- 
al problems of students who speak little or no English enabled the several pro- 
grams designed to better educate those children. The Texas legislation and sub- 
sequent programming, now about a decade ago, gave a substantial impetus to the 
provision of bilingual education and other special services, such as English as 
a second language classes. Texas, like most states, was unprepared to introduce 
these programs. The ESEA Title VII programs were of inestimable assistance to 
the state and districts, as well as the universities, in the preparation of ma- 
terials, funding local programs, and training teachers. 

Historical Develooment 

East Texas State University was one of the early Texas institutions to begin wor\ 
toward providing teachers. With a small early grant, a great deal of effort was 
expended in assisting districts in the preparation of materials and their instruc- 
tional modes in multicultural education, an essential component in helping child- 
ren adapt to school and enhance their feelings of self worth. The growing number 
of limited English speaking children in the North Texas area gave a high priority 
to teacher preparation there. East Texas State adversity's history of services 
to school districts placed it in an advantageous position to begin the training. 

1976- 1977 

Although funded after the beginning of the academic year, the University was able 
to utilize the fall profitably by completing the course syllabi, certificate pro- 
grams, and degree program plans that had been begun earlier. Bilingual staff was 
acquired and/ or identified to conduct the courses . An agreement with the Dallas 
Independent School District was solidified so that services could begin at the be- 
ginning of the next quarter. 'The first students began their programs in spring, 
both at the Cccmerce campus and in the satellite service center in the Dallas me- 
tropolitan area. 

Most of the first students were certified teachers with experience in the class- 
room but who had had no training in implementing bilingual education. For the 
most part, they took courses that would allow them the bilingual education en-, 
dorsement but many also elected to obtain the masters degree over a period of time, 
A summer program was also utilized for these same purposes , plus making it possi- 
ble for degree seekers to fulfill part of the residency requirement. 

1977- 1978 

During the second year, the major processes associated with the consolidation of 
management, enhancing the resources and services available to the participants, 
and the extension of the work to include a larger number of agencies and institu- 
tions . The early cooperation with the Dallas Independent School District was 
continued and ihe McKinley Independent School District was added. East Texas 
State University membership in the Federation Bilingual Training Resource Center 
increased the resources available to the Title VII program and in return, the 'uni- 
versity contributed experience based knowledge to the management of the Federation 
operations . An augmented thrust the second year was the strengthening of the \rork 
with the Mexican American cctnruni ty , especially in the principal target area, Dal- 
las, both by including that segnent of the population in the management aspects of 
the program and in providing leadership enhancement training and other services to 
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its members. Student enroll Trent at the undergraduate and graduate levels grew 
rapidly, allowing a full conponent of courses toward the certificate endorse- 
ment and the degree programs. 

1978- 1979 

This year, with the courses, programs, and management firmly in place, the East 
Texas State University ESEA Title VII program was able to further extend its ser- 
vices to add several new districts: Diocese of Dallas, Irving, Garland, Piano, 
Ennis, Mesquite, Mt. Pleasant, Paris, Tulia, and New Braunfels. Students were 
drawn from an ever larger area while the participation from Dallas was incr eas ed 
From the beginning, relations with the Texas Education Agency, the educational 
service centers, and other universities in the area were positive. One evidence 
of this was the cooperative effort between the Agency and the University to offer 
the first courses on the teaching of English as a second language during the sum- 
mer term. Counseling assistance with a Native American organization, while not 
resulting in a bilingual program, improved services to that group. 

1979- 1980 

This fourth year showed further consolidation and expansion of the program. The 
courses were updated and additional materials were included as they became avail- 
able. Permission to grant a doctorate was sought and obtained, and the federal 
funds for a few scholarships for that level were achieved. Specialist programs 
beyond the masters degree were also inaugurated. The number of undergraduate stu- 
dents was increased and the masters program continued to grow. Beginning efforts 
to provide assistance to other language groups showed difficulties in meeting the 
requirements for these minor languages but assistance to multirultural instruction 
was provided. The university and the Texas Education Agency again cooperated on 
summer courses in teaching English as a second language. Funds for working with 
the target communities were not provided this year but some of the activities were 
continued via volunteer work by the students and the staff. The Federation Bilin- 
gual Resource Center was not refunded and the loss of materials from that organi- 
zation was a significant one, even though the member universities attempted to 
take over the functions the Federation had given. 

1980- 1981 

During this fifth project year, East Texas State University was able to increase 
the participating student numbers even though; many colleges were experiencing 
substantial decreases. Further, more and more students were being attracted to 
the program from other parts of the state, from other areas of the US, and from 
Mexico. A bilingual science 2ducator was added to the faculty. Management was 
modified to relieve the enormous burden that was shouldered by the administrators, 
and the University was able to add a staff person. This year, too, the library 
holdings were expanded at the Satellite Learning Center, improving student review 
of relavent research and other literature. 

1981- 1982 

The sixth program year gave more emphasis to the undergraduate instead of the gra- 
duate enrollments; the undergraduates increased and there was some decrease in the 
graduates. An endorsement plan to add English as a second language to the teach- 
ing certificate was approved and gegun in operation. Several changes in the up- 
per management of the University were made this year and the new officers were 
oriented to the bilingual education program. Services to new districts increased 
as the Texas laws added new dimensions to the services that had to be provided. 
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1982-1983 



Year seven saw the proportions of undergraduates and graduates remain a tout the 
same except that fewer doctoral fellowships were available. Administrative exi- 
gencies caused a consolidation of the two management posts into one; the long 
experience of the coordinator - made it possible to continue effectively as the 
director. Two more bilingual professors were appointed to graduate faculty sta- 
tus, facilitating the advice to students and reducing the work load on the di- 
rector. Funds were not granted for the news organ, Boletln, but other conmuni- 
cations continued at a satisfactory level. 

1983-1984 

New University standards caused a slight decrease in new enrollments, parti cular ly 
with the undergraduates, but the program maintained its overall enrollment. The 
addition of an English as a Second Language certificate endorsement and degree 
programs, facilitated by the several years of cooperative course offerings with 
the Texas Education Agency, was popular since that subject area has increased in 
the local schools . Cooperation with North Texas school districts was spurred by 
the new English as a second language programs with advisory services needed to 
aid the districts in setting them up. Both the bilingual and the English as a 
second language certificates were extended to secondary schools, thus the pro- 
ject worked extensively with the Department of Secondary Education to implement 
the courses and curricula. 



1984-1985 

No ESEA Title VII funds were granted for this academic year. The program, however, 
continued in operation, a testimony to the institutionalization effected by East 
Texas State University. The loss of the stipends to eligible students, a severe 
blow since many other scholarship funds were also in short supply, caused some 
students to at least temporarily leave the program. The enrollment, though, was 
not decreased as much as had been anticipated; the greatest losses were in new 
enrollments . 



Institutionalization Review 



From the very beginning, East Texas State University consistently planned for ma- 
xinum institutionalization of the ESEA Title VII project into its regular opera- 
tion. The first and third directors were already within the tenure track sys- 
tem; the second, new to the University, was employed in that same status. Some 
federal funds were utilized to pay for the project's work but the University al- 
ways paid a part of the salary. Most of the professors, too, were regular em- 
ployees, paid at least partially within the regular budget. Additionally, the 
University actively recruited qualified faculty members for the positioris. not 
only in the bilingual and the later English as a second language programs, but 
also to offer the basic courses in the sciences and social sciences. Some por- 
tion of their salaries was from federal funds, especially that part relating to 
monitoring the students and providing the special services to school districts. 
A few adjunct professors were necessary at heavy load periods; only one long term 
faculty member remained for an extended time in that status. 



It is also important to note that the University made no special, interim arrange- 
ments for courses or for degree or certificate programs. Each one followed the 
regular path through the several committees and their approval was mandatory for 
inclusion in the training project. Further, the courses and programs were sub- 
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ndtted to the Texas Edu ca t ion Agency and the State Board for approval as inclusion 
as regular University courses and programs. Evidence to the success of this ef- 
fort included their approval by the reviews of the Texas "ducation Agency, the 
Southern Association, and the Educational AdnrLnistratic- - - reditation. 

A vital component in the formulation of the bilingual _. .cion program was the 
acquisition of an extensive set of regular library references and specialized 
teaching materials. While the Title VII funds helped in this collection, the li- 
brary also used much of its own funds. Further, since two principal sites were 
utilized for the instruction, the home campus at Commerce and the Satellite Learn- 
ing Center in the Dallas area, the provision of an adequate set of materials in 
both places furnished all students the opportunity to make use of them. While 
this substantially raised the proportion supplied by the University it was seen 
as necessary to the implementation of the Title VII project and to the general 
education provided by the University. 

In. sumnary, East Texas State University managed an unusually high degree of insti- 
tutionalization of the ESEA Title VII project into its regular system. The evalu- 
ator has studied and consulted with many Title VII university programs and none 
was able to incorporate the staff into its tenure track system as successfully as 
did East Texas State University. Further, the total integration of the courses 
and programs, and the strong conmitment evidenced by the library holdings, are 
also exceptional. The University made wise use of the federal funds and, too, 
invested substantial sums from its own revenues into the the bilingual education 
program. 

Professionalization Perspectives 

The operation of an ESEA Title VII project involves a great deal of routine work, 
that pressure often used as a rationalization ' for avoiding coranittee assignments \ 
for not serving orgardzations and agencies , and for the lack of professional pub- 
lications. This was not the case of the project personnel at East Texas State 
University. 

o The staff served on the committees for graduate students, curriculun, 
certification, graduate school, advisory committees, faculty selection 
groups, and special committees set up by the University. 

o The faculty was active in the National and Texas Associations for Bilin- 
gual Educatior, the Foreign Language Association, with the North Texas 
University Federation, and many other professional organizations. 

o The professors functioned as advisors to the nearby regional service 
centers, aided in the development of programs for them, and authored 
and co-authored publications for those agencies; they also worked in 
several capacities and as publication contributors to the Evaluation 
and Dissemination Center in Dallas. 

o They read papers at many professional meetings and published important 
contributions on language, social organization, and teaching, notably: 

Children' s Literature Anthology (ETSV) 

Mexican Americans in a West Dallas Barrio (university of Arizona Pres.';) 

Bilingual Special Education: A Challenge for the 1980s (TABE) 

Una Buena Maestra/A Good Teacher: A Preliminary Report of Parental 
Views in a Texas School District (Applied Anthropology) 
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e Prevention of Beading Disabilities in Bilingual Students (ETSV) 
o Cancionero Bilingue (ETSU) 

o Beading and Bilingualism (Texas Council of Beading Bulletin) 

o English and Spanish in the Bilingual Child (Teachers of Spanish and 
Portuguese) 

o Annotated Bibliography of Bilingual Legislation and Court Cases (ETSU 
Library) 

o Mathematics for the Bilingual Child (Begional Service Center) 

o The Social Studies in Bilingual Education (Begional Service Center) 

It should also be noted that nuch of the study material for the universi- 
ty students was developed by the faculty since most textbooks were general 
rather than specific to the needs of the North Texas area. 

Finally, the professionalization of the faculty is evidenced in the many services 
to the Texas Edu cation Agency deliberations on certificates and programs, to the 
Regional Service Centers , and directly to school districts . One faculty menfcer 
served on the advisory camrLttee to fche California Legislature study of education- 
al services to limited and non-English speaking students, a longit udin al evalua- 
tion that has served as the model for many other studies, including the present 
national evaluation. 

Program Processes 

The program at East Texas State university was designed to increase the effec- 
tiveness of teachers and administrators in meeting the needs of limited and non- 
English speaking pupils in the state, and especially in the northern part of the 
state. The programs at all three levels - undergraduate, masters, and doctorate 
- first offer a strong preparatory program in the several kinds of subject mat- 
ter to be taught, in the methods for general education, in the specific methods 
for bilingual education, and in linguistics and the Spanish language. That is, 
the University is concerned that the participants know, for example, mathematics 
and how to teach mathematics in both English and Spanish. Bilingual and multi- 
cultural skills in counseling, administration, and other specializations are in- 
cluded. Expertise in working with parents and other comnunity menbers of differ- 
ent cultures is an important part of the program. 

As would be expected, then, Eajt Texas State University incorporated a wide vari- 
ety of academic resources into the program, utilizing the knowledge and expertise 
of many disciplines: English, Spanish, linguistics, history, sociology, anthropo- 
logy, psychology, education, and administration. This necessitated the coopera- 
tion of three colleges and several departments within the University, as well as 
the graduate division. The degree design and the course syllabi were carefully 
prepared with the advice of the bilingual education personnel of the Texas Educa- 
tion Agency, the Dallas Independent School District, and representatives of the 
potential students and cacnnunities . Further modifications were made as each suc- 
cessive year's experiences were evaluated. New courses, programs, and certifi- 
cates were added as they became appropriate for the schools and authorized by the 
State of Texas. 

Many courses were offered in the districts from which the students came, helping 
to increase the reality based nature of the program. Field experiences 'were also 
provided for students not currently teaching in bilingual education. Resource 
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persons from the Mexican American ccmnunity, both general citizens and a ranker 
of professionals, were brought into the planning process. East Texas State Uni- 
versity staff markers with skills and experience in related fields were utilized. 
This combination, together with the Mexican Americans and other Latin Americans 
on the staff, furnished expert inputs. 

An essential ingredient in the plan was the participation of the bilingual teach- 
ers in the presentations in the classes , whether brought in as special resources 
or included as participants. The knowedge and skills they had gained, the ma- 
terials they were using, and their general experiences added a substantial dimsn- 
sion of practicality to the training. 

Just as inportant, too, was the use of the Spanish language in the courses by 
both the professors and the students. While there were sone limitations to the 
oral/ aural capabilities with Spanish in both groups , each was expected tc strive 
for a continual increase in the amount of Spanish in the lectures, discussions, 
and written work in order to provide some of the bilingual environment and fur- 
nish opportunities for the acquisition of a professional grasp of the language. 
The university chose professors with the greatest coumand of Spanish while at 
the same time being specialists in their fields. 

Liaison services were also incorporated. Faculty with appointments that allowed 
monitoring of classes in which the students worked made this possible. These mo- 
nitors assisted the students with any problems encountered in implementing bilin- 
gual or regular education, and as well helped the principals of the schools in 
many ways. Also, these liaison services helped keep the faculty abreast of bi- 
lingual education in the schools. 

Since Latin Americans and Spanish were relatively new to the North Texas area, 
the University recognized the need to increase the professional contacts between 
these groups and the faculty and students. Coomunity involvement was vital in 
this regard, augmenting the direct experiences with the families of the children 
being served. The university also brought in well known Mexican Americans in 
labor, business, the media, politics, education, and research, so the faculty 
and students could attend seminars and discussion sessions with them. These ap- 
pearances were well received, not only by those involved in bilingual education, 
but as well by other faculty and students, and the coummity at large. The press 
was especially interested and many useful articles were published in the area; 
television and radio furnished exposure to an even wider audience. 

The faculty and students assisted appropriate student and ccmnunity organizations 
to conduct their own programs and to become acquainted with bilingual education, 
labile these concentrated on Mexican and other Latin American organizations , the 
multicultural aspects were enhanced through the participation of faculty and stu- 
dents in organizations of other groups such as Native Americans , Blacks , and 
Asians. Some important help to districts was enabled via these contacts. 

In summary, the East Texas State University ESEA Title VII Bilingual Education 
project was a fully integrated set of processes. Intense interaction among the 
University cccmunity, the areas and districts served by the program, the several 
organizations important to the cultures and languages, and the official agencies 
of the State and Federal governments was an intentional ingredient. Too, the 
courses and programs were fully incorporated into the regular University 'struc- 
ture. Similarly, the instruction emphasized the subjects and methods vital to 
good teaching in any setting, then bilingual education was added to it. The re- 
sult was high acceptance by the comnunities and professionals. 
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THE EVALUATIONS 



Three separate approaches were utilized in the evaluation of the 
East Texas State University Title VII Bilingual Education Program: 
internal, external formative, and external summative. The first 
internal, had two sources - the regular University evaluation acti- 
?-5i 16S tr?? the monitoril *g of all work by the administration of the 
iitie VII project. The second, formative by an external evaluator, 
was accomplished through an exit interview and an interim written re- 
port at the conclusion of each external monitoring. The third, sum- 
mative by an external evaluator, was primarily composed of the pre- 
sentation of the data and conclusions through the annual report. 



Internal Evaluation 

East Texas State University maintained strict accounting of student 
enrollment, fiscal management, and faculty preparation for teaching 
the courses. The University was thus the most efficient source of 
information on these areas and it furnished reports on them to the 
funding source through its regular channels. 

The supervisory functions of the deans of the colleges and of the 
heads of departments, added further dimensions to the management of 
the project. University wide committees on curricula, courses and 
degrees contributed to the development of quality in the program 
Faculty committees for the students seeking the undergraduate and 
graduate degrees, unique to each student or handled by an advisor 
maintained an individual completion and quality control, as well as 
contributing to the students' development in the profession The 
Academic Vice President was directly charged with the supervision of 
all teaching/learning programs, thus involving the central admini- 
stration in the evaluation function. 

Special advisory committees to the bilingual teacher training project 
also were constituted, including members from appropriate university 
entities, the Dallas Independent School District, students, and the 
community. These committees' functions in planning, assessment and 
revision of the program helped assure that the objectives were 
reached. 

The project staff also used a wide variety of consultants to aid in 
the several phases of the program. Representatives from the region- 
al education service centers, the Texas Education Agency, community 
organizations, faculty from other universities, and the US Department 
of Education, added further depth to the evaluation. The continuous 
input, through the liaison personnel, from the aides, teachers, and 
administrators of the several schools and districts from which they 
came, also gave an internal formative evaluation dimension difficult 
to achieve in most university programs. The liaisons completed a 
standard form after each monitoring or assistance visits to the 
schools, with the district administration, and when participating in 
community activities. (See the form in Appendix B.) The information 
from these was integrated into the internal project reports at mid 
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5CHEMATUM OF THE PROJECT EVALUATION DESIGN 



Internal 



Sources : 

University Departments, 
Colleges, Central Ad- 
ministration 

Coordinator, Bilingual 
Education 

Director, Title VII 
ESEA Project 

Ext*»-rr>ai Evaluator 



Monitoring ; 

Supervision of faculty and 
students, schedules, pro- 
grams, and syllabi 

Academic advising and review 
of student progress 

General management and fiscal 
control of project resources 

Feedback from monitoring 



External 



US Department of 
Education 

Dallas Independent 
School District and 
other participating 
districts 

Texas Education Agency 



External Evaluator 



Supervision of programmatic 
and fiscal elements 

Recommendations on participants 
and programmatic aspects; 
feedback on student progress 
as they teach 

General supervision of the 
certification program and 
course offerings 

Monitoring of all activities 
through observations, inter- 
views, and document reviews ; 
evidenced in interim and fi- 
nal reports and conferences. 



9 

ERIC 



Development associates, In c. 



IP 



year and at the conclusion of the year, thus they were not included 
in this external report. Further, the information from the other 
internal evaluation activities were embodied in the project's re- 
ports and likewise were excluded from the present study. 



External Evaluation 

In 1976, East Texas State University contracted with a private firm 
Development Associates with headquarters in Arlington, Virginia, and 
a branch office in San Antonio, Texas, to perform the external eva- 
luation. The company has conducted many local, regional, and nation- 
al surveys, needs assessments, and evaluation studies in the field 
of bilingual education. The agreement called for both formative and 
summative evaluation for the year 1976-1977. 

Dr. Earl Jones, senior associate and bilingual education specialist 
was assigned the major research tasks connected with the contract. ' 
His experience in bilingual education in Texas and Paraguay, and 
later in California and Guatemala, his proficiency in English and 
Spanish, his teaching, research, and administrative roles in schools 
and universities, together with his service in evaluating a large 
number of Title VII and other bilingual programs, gave him the wide 
perspective necessary for this project evaluation. (A curriculum 
vitae was appended to the 1976-1977 i .port.) 

The contract was renewed during e second year, 1977-1978. When 
Development Associates closed it* Texas office, an agreement was 
reached thereby Dr. Jones would continue the external evaluation 
with the E.ist Texas State University program as an independent affi- 
liate w/ith Development Associates. Subsequently, Dr. Jones was 
transferred to the San Francisco, California, office of the company 
as director of the Study of California Services to Limited and non- 
English Speaking Students, funded by the California Legislature. The 
independent affiliate relationship was maintained for the East Texas 
State University contract and the later formative and summative 
activities were conducted under that arrangement. 

The funding for the formative and summative evaluation has always 
been severely limited. To maximize the utility of the activities 
therefore, the agreement called for the following tasks, each to ' 
serve both functions: • « 

. Monitor the graduate classes offered. 

. Survey sample bilingual education classes taught by the 

participating students. 
. Seek information on the conduct of the program from both 

district and University officials. 
. Study the documents related to the project or emanating 

from it. 

. Confer with the project personnel and teaching faculty on 
the implementation of the project. 
Recommendations were to be made to the project staff after each task 
providing formative information for the improvement of the program. 
Two monitoring schedules were provided and conducted, and both oral 
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and written Interim reports were submitted to the director. Summaries of the 
findings were incorporated, when pertinent, within this annual report. 

As a result of the first evaluation tasks in 1977, including a study of the pro- 
ject documents and conferences with personnel, a more precise investigation into 
the students' perceptions of the program was recommended. The agreement was mo- 
dified to include this facet. The instruments were then derived cooperatively 
by the evaluator, the project director, and the faculty advisory committee. The 
questionnaires were administered, the data analyzed, and the results reported in 
each of the annual and interim reports since then. At the beginning of the pre- 
sent project year, a review of the results for the past several years showed a 
few questions producing little of utility to the project. The instrument was 
appropriately modified and the present version is contained in Appendix a. 

Monitoring 

Funding permitted two sets of monitoring, one conducted in late fall and the 
other in sunnier. Regular class conduct was monitored during alternate obser- 
vations of lecture, discussion, and other activities on the home campus and at 
the Satellite Center in Dallas . Even alternate sessions did not cover all the 
activities, and at times, classes, and the information was supplemented through 
open ended interviews with a sample of the students. Interviews with the pro- 
fessors and reviews of their syllabi furnished additional data on the courses 
and changes that were effected in them. 

Additionally, a number of other activities of the project were monitored during 
the two periods: a special seminar by an outside consultant, meetings with the 
certification and advisory cotnnLttees , a general student meeting, and special 
conferences with the university President, the Dean of Education, and the Head 
of the Department of Elementary Education. 

Project Documentation 

The project proposal and its subsequent negotiated modifications, the interim 
reports by the project personnel, and the continuation documents submitted to 
the US Department of Education, were provided for examination. Resource materi- 
als, research and class papers by students, correspondence with several agencies, 
and the project arrangements with the Federation of North Texas Universities were 
reviewed. Evidence of faculty and student participation in professional activi- 
ties was also furnished. 

The Student Perceptions Study 

The student study was set up to provide interim data, via student opinions, on 
the conduct of courses, progress in Spanish, content or methods offered and 
needed, suggestions for improving the program generally, and ratings of their 
degree design. Additionally, the instruments wer°. prepared so they could be 
coded and analyzed through computer services to reduce the costs to the evalu- 
ation and to furnish longitudinal analyses across the years. 

The data analyses were performed at the Computer Center of Trinity University 
in San Antonio, Texas, the first two years, utilizing punch cards that could 
be input in subsequent years. These were later transferred to tape as the cumu- 
lated data became too bulky for punch card input. The process was continued via a 
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"nSe'tha? ?ISf rafll f?ie S cLi^ nCi r 0 C? al f fornia ) State University 
thS 1976?f 077 S;«nil 5 g and anal > sls setup were detailed in 
5 or? 77 re P° rt and are not repeated herein.) Versions 6 a 

P «lllTlli-*o°l e . T * n lon « itudi - 1 "udief, including SiTSSd™?.:" 

The instrumentation comprised three separate forms. The first 
EI 1 -*/ 0 ^! certain ^graphical/demographic Sta to be used 
ts S J ^r tiatin ? variables for fnafyzing the long Se™ 
suits. Students were also asked to rate their proficiency inn 
aural and reading Spanish when they began the p?ogram That ra 
?Sj°?l^ fl SUPpl i ed t J e basis for subsfquent analyses of pro/re 
Irll l^t gG - B re£ l ue sted suggestions for improving the 

gram and the individual courses, and obtained an update on thei 
Spanish proficiency. The opinionnaire , Form C inkeeni™ litl> 
general University policy of student evasion of counsel 2 lv 
opportunity for rating the several design and coSauc?Ispectf o 

"/r'S 1 r3ting 0n each ' ^estimates of the^mJun? 
Spanish used by the students and the professors in the courses 
three forms are included in Appendix A.) courses. 

aVlhl fi!/J?Ii year -' 5 he ^"^onnaires were handed out during one 
Jt.JS^ S P eriods with an explanation of the purpose The 

students were urged to participate. The professor then left the 

^arilv d^o \ tUd , en S%r h ° Wi5hed t0 Cora ' lete an ins??umlnJ, volun- 
tarily, did so, handed them to a student who sealed then into a 

stamped envelope and mailed the package directly to the evador 

wouSTsee 5 the Seref ■ n \ ithM the " T0 ' eCt s taf f °nor° th^pro'f es'sor 
would see the completed instruments. Students were allowed tn «„>, 

mit evaluations without including their social security numbers if 

.crn'J 1 ^^- Sli 2 htl y »« than 104 of them has Jef "th?s 
across the years. oiariK. 

laUin^aoout SoHnT^ 011 W * S disa PP°^ting in some classes, to- 
talling about 20% in one case and rising to about 80% in others 
The student monitor had been provided a list of the stuSents and was 
asked to note those that had completed a questionnaire Because of 
the relatively low rate of return, it was lubseqSSSy 'decided "hat 
the list might have been a deterrent to responding; it was thereafter 
dropped The response rate for the following quarter then roll dra- 
matically. Again, however, the rate decreased to its lowest level 
pSrtSni^v^n'm'n 6 ^ Conse S^ntly, students were also given III "op- 
portunity to mail the questionnaire themselves. Professors were also 

h^'rneglected'to^d^so 6 ^ iinct interv iews show^ that %^ 1S ° 
SI?i,S« g ♦ u °* J An lncrease wa s then experienced but the 

return rates have varied considerably across the years since then. 

Substantial increases in the instrument return rates have been pynpripn,^ 
the last three years: 135 in 1980-1981, 147 in 1981-1982 and\IT£ ?93 t k 7 
A part of the increase is due to rare undergraduates ^™ ccSrse^ bu? 
graduate students are also completing nore evaluations. DUC 
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+L J • C Se6n ln *?? * ables reporting the results of the analyses, 
the N sizes were small for some courses and some sessions. In some 
courses, the number of students was quite small, especially those 
related to research and the individual projects, appropriate to the 
nature of that type of work. Absenteeism no doubt alsS accounted 
for some of the losses. The voluntary aspect also reduced the num- 
ber sent in. Because pf these circumstances, there was no necessary 
relationship between the number of respondents listed in the tables 

this report and the enrollment in the courses. The small numbers 
weakened this portion of the study but could not have been avoided 
without prejudicing the rights of privacy of the students. 

To ascertain whether the low response rate for some courses biased 
the calculated replies, an examination of them was conducted. The 
study showed that excluding those with only one or two forms, no 
necessary relationship existed between the number of respondents and 

?un ^T^w^- 15 ' ? tudent * submitted instruments with low, med- 
ium, and high ratings in all but four courses. In those, no weak or 
very weak ratings were checked and only four fair replies were regis- 
tered for all of the different course components. In two of the four 
only strong and very strong ratings were given. In othor courses, 
however, and often involving the same students, some very low ratines 
were assigned. Interviews with some students were also conducted to 
examine the possibilities of biases and no direct relationships ap- 
peared. Some students who did not submit evaluations stated they 
simply did not do so; their stated ratings would have included the 
complete range of ratings offered. It is believed, therefore, that 
no substantial bias entered the ratings when three or more students 
completed the forms. 

The instruments, as received via the mail by the evaluator were 
then coded and keypunched for statistical analysis. The codines 
were 100* verified, the analyses performed, and the appropriate tab- 
les for the report were prepared. The computer cards for all the 
years to date were subsequently committed to magnetic tape for use 
in future longitudinal analyses. 

Two kinds of data were transmitted to the project. The general in- 
formation included in the tables in this report, plJ the SiHussicns 
with the director, was the first and most important to the formative 

3?J ^ 1 ?w/-°5- S -!T S i Were giV6n the °PP°rt.unity to request private 
data on their individual courses but only two did so. This annual 
report, including some analyses across the six years, was also to 
be tendered to the project director for the use of the University, 
the Bilingual Education Program, and the US Department of Education. 
The specific course designations are not disclosed within this re- 
port to protect the instructors. 



Limitations to the Evaluation 

Despite the several sources of information and the broad coverage of 
the design, one obvious weakness remained without investigation: the 
impact of the program on improving the teaching abilities of the stu- 
dents such that their pupils learned more. Stated more succinctly, 
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as a question, did the children in the classrooms of the students 
learn more because their teachers were participating in this project 
and degree program? The difficulties of such measurement are myriad 
and even controversial. The subject should not be avoided, however 
simply because measurement is difficult and because the project 
lacked the funds and other resources to carry out such a study Se- 
rious thought to providing at least some tentative conclusions " should 
be given and some resources should be provided by the US Department 
of Education 01 other entities to conduct this important research. 

Finally, the funding provided for external evaluation was small and 
the investigations, therefore, were necessarily brief, even in some 
cases cursory. The report must be taken within that limitation. 
Despite this handicap, a great deal of useful information was fur- 
nished throughout the study and that information helped the Univer- 
sity and the project improve the program and its services. The ex- 
ternal evaluator knows of no events or processes that were not scru- 
tinized and therefore submits this report with confidence in the 
findings unless otherwise stated. 
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THE STUDENTS IN THE PROGRAM 



East Texas State University conducted a needs assessment on the 
training required in the North Texas area at the beginning of its 
program. Utilizing the data available from the Texas Education 
Agency, published research, and surveys in the immediate geographic 
region, it was evident that the deficiencies in all levels of re- 
sources to conduct bilingual education were critical. The Mexican 
American population was growing very rapidly in the Dallas and Fort 
Worth areas; moderate increases were noted in the smaller popula- 
tion centers throughout the North Texas portion of the state. 

The first thrust, and still the largest in terms of numbers, was the 
provision of bilingual education methods and techniques to already 
certified teachers in elementary schools. Two options were avail- 
able: the courses needed for the endorsement to the elementary cer- 
tificate and a full masters degree program in bilingual education. 
As soon as this program was stabilized, the University then planned 
and negotiated approved programs for undergraduates so they could 
enter the bilingual education field directly; a specialist program 
beyond the masters degree was needed that would equip experienced 
personnel to aid the administration and teachers in the implementa- 
tion of bilingual education; and the doctorate in education, which 
would provide both specializations and at the same time furnish 
high level personnel for other functional positions in universities, 
agencies, and local administrations. 

All four levels were direly needed throughout the North Texas area 
and the nation. Increases in the number of pupils that could bene- 
fit from bilingual education and programs to serve them, have kept 
the demand high. The four programs are still needed if the students 
in elementary and secondary schools are to be educated within an er 
vironment that will facilitate their abilities to enter, profit from, 
and contribute to the educational, social, political, and economic 
life of the state and the nation. 



Program Participants 

The majority of the East Texas State University Title VII partici- 
pants came from the Dallas Independent School District, which co- 
operated directly with the program. Many others, however, came from 
other districts in the North Texas area, and recently, from all over 
Texas . 

In the early years, almost all the participants were teachers in the 
first four grades of school since that was the emphasis for bilin- 
gual certification. Since that time, the numbers of participants 
from the other grades and from other positiors in the schools have 
increased markedly, demonstrating an attraction to the East Texas 
State University program. That change is significant since several 
universities in the area offer some levels of training for bilingual 
educat ion . 
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The University guarantees the privacy of Information, therefore, the reporting 
on the several characteristics studied is voluntary. Too, many students parti- 
cipating in the courses were not assisted financially by Title VII The two fac- 
tors combine so that the percentages cited in the accompanying tables do not ne- 
cessarily translate into the numbers officially registered as ESEA Title VII 
participants . 



The wide variety of occupations of the reporting participants is displayed in 
Table 1. The changes across the years represent differing eraohases in the 
schools , on the privision of bilingual education and ESL in different grades 
and the group receiving special assistance from the project. 

Table 1: Coriparative^Frequencies of Reporting Participants by Occupation from 



Occupation 


L976 
% 


1977 
% 


1978 
% 


1979 
7o 


1980 
7o 


1981 
7» 


1982 
7o 


1983 

7, 


1984 

7o 


Teacher: kindergarten 


10 


12 


12 


14 


12 


4 


3 


1 


3 


grades 1-3 


36 


47 


48 


43 


30 


27 


22 


27 


35 


grades 4-6 


13 


13 


14 


4 


15 


12 


9 


12 


10 


grades 7-8 


4 


2 


4 


8 


3 


8 


6 


* 


0 


grades 9-12 


3 


1 


4 


7 


7 


6 


5 


14 


10 


adult 


0 


0 


0 


0 


0 


0 


0 


1 


0 


Aide 


** 


*>v 




** 


6 


8 


5 


0 


9 


Volunteer 


0 


0 


0 


0 


1 


1 


1 


1 


0 


Administrator 


2 


2 


3 


6 


6 


2 


3 


3 


D 


Computer/media 


0 


0 


0 


0' 


1 


1 


0 


1 


0 


Curriculum writer 


1 


2 


2 


2 


3 


2 


1 


1 


0 


Resource teacher 


1 


1 


2 


2 


4 


0 


1 


1 


8 


Student/unaiployed 


** 


VoV 


** 


** 


6 


18 


42 


38 


17 


Unspecified other 


15 


13 


11 


24 


1 


4 


1 


0 


2 


No response 


1 


9 


0 


0 


0 


3 


2 


0 


0 



* Grades 7 through 12 were combined into a single "secondary" response. 
^Between the 1979 and 1980 reports, the computer program was expanded to ac- 
count for these specifications formerly grouped under "other." 

The principal drawing area was the Dallas area; as the teachers there gained the 
credential and/or degree, decreases were expected. However, these were partially 
offset by the inclusion of other area districts and by losses from the already 
prepared teachers . The large increase in students that were unemployed mostly 
resulted from the changed emphasis to funding that group. 

The total and bilingual teaching experience of the students in the first few years 
was fairly stable. As many of the experienced instructors completed their certi- 
fications and degrees, the total experience diminished. The bilingual experience 
continued to rise until 1982, when the higher proportion of undergraduates dilu- 
ted that factor. Similarly, the 1983 offerings for ESL teachers, many of whom 
cb not teach in bilingual education, decreased the experience variable for bi- 
lingual but not the total years. Table 2 compares the frequencies for both to- 
tal and bilingual experience for the last five years; 1979 was representative of 
the previous project years and thus the entire project period woulu have added 
little to the information. 
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Table 2: Comparative Frequencies of the Total and Bilingual Teaching Experience 
of the Participants: 1979-1984 * i^perxence 



Experience 
Categories 



T °tal Bilingual 
1979 1980 1981 1982 1983 1984 1979 1980 1981 1982 1983 1984 



% % % % 



% 



% 



None 

Less than one year 
One to two years 
Three to five years 
Six to ten years 
Eleven years or more 
No response 



4 
8 

18 
29 
18 
23 
0 



4 
6 
11 
39 
20 
20 
0 



12 
16 
16 
14 
14 
16 
10 



39 
14 
11 
11 
8 
8 
3 



33 
14 
15 
12 
19 
11 
6 



20 
5 
18 
25 
26 
8 
0 



8 


6 


22 


44 


48 


20 


29 


21 


29 


19 


17 


20 


22 


11 


16 


14 


16 


20 


25 


38 


14 


5 


9 


25 


10 


12 


4 


7 


11 


15 


6 


12 


2 


2 


3 


0 


0 


0 


0 


9 


5 


0 



The. relatively large increase in the "none" category in 1983 when compared to 
1982 represents mostly those teachers returning to the University to gain the 
ESL training, many of whom had not been involved in bilingual education The 
n {™ r ° f ^dergraduate students, also a part of the "none" category, remained 
about the same although their percentage of the total reporting was slightly 
smaller than the previous year. ^ J 

The proportion of male to female students was stable the last four years with 
only minor variations . (Table 3) The Proportion of males continued higher 
than in the early years of the project. 

Table 3: Male and Female Proportions among the Student 
Populations: 1979-1084 



Sex 


1979 1980 1981 1982 1983 


1984 


% % % % % 


% 


Male 
Female 


12 19 16 18 18 
88 81 84 82 82 


15 
85 



Ethnicity changed a great deal in 1981 and some of that difference remained in 
1982 and 1983. In all the earlier years, Mexican Americans had made up more 
than half. In the latter years, the number decreased, as did the percentage 
while the number of Anglos and other Latin Americans increased. It should be 
noted, hoover, that some Mexican Americans that speak little or no Spanish 
classified themselves in the "Anglo and other" category. (Table 4) 

Table 4: Reported Ethnicity Frequencies: 1979-1984 



Ethnicity 26 


1979 
% 


1980 
% 


1981 

% 


1982 

7o 


1983 

fa 


1984 

/o 


Mexican American 


53 


55 


37 


43 


41 


50 


Other Latin Americans 


0 


7 


8 


10 


11 


8 


Black 


2 


0 


2 


1 


1 


2 


American Indian 


0 


0 


2 


2 


1 


0 


Anglo and other 


45 


38 


52 


44 


46 


40 
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The changes In the composition of the participants across the years by and large 
follows tie. proportionate need and with subsequent reductions when the greatest 
need was met. Subsequent changes in the laws, such as the addition of new en- 
dorsements and certificates, were again reflected in the enrollments. Note par- 
ticularly: 

Hie kindergarten scarcity was met during the first five years. 

The grades 1-3 enrollment was high at the beginning, since those 
were the target grades, declined somewhat, and then rose 
again when the ESL endorsement be came available. 

Secondary remained quite low until the bilingual and ESL certifi- 
cates were extended to that level. 

The unspecified and no response categories declined after a period of time, appa- 
rently due to increased confidence that the data would not be associated with the 
names and other identifiable information. 

The experience levels remained almost exactly the same during the first four of 
the program years, thus the first three are omitted from the table. After that, 
seme changes occurred in the total experience: 

The no experience group increased rapidly when the emphasis on pro- 
ject funding was shifted to the undergraduates. 

The more experienced levels decreased as these teachers acquired 
their endorsements and degrees; there was another increase when 
the ESL endorsement became available. 

Bilingual experience, on the other hand, followed a fairly steady decline since 
these teachers hurried to obtain their endorsements early. Some increase was 
evidenced during the last two years as the bilingual teachers decided to work 
toward the ESL endorsement. 

The sex ratios did not change appreciably across the years . Men generally made 
up about fifteen percent. 

Mexican Americans made up the majority of the students at the beginning but the 
proportion declined after the early bilingual teachers earned their bilingual en- 
dorsements. It rose again, however, when the ESL endorsement became available. 
Blocks and Native Americans rarely enrolled, primarily because of the requirement 
to speak or learn Spanish. It was anticipated that the ESL programs would augment 
their numbers but that did not occur. 

East Texas State University, in its ESEA Title VTI project, was able to attract 
the kind and quality of students stated in its objectives. The initial urgency 
to train those teachers already teacliing in bilingual classrooms, but without 
the desired training and certificates, was met. Subsequently, degrees, reflecting 
the full spate of bilingual courses, were the attracting element. The quality of 
the programs kept the students enrolled beyond the exigencies of certification, a 
major success of the University. 



Development Associates, inc. 

ERIC 17 



PARTICIPANT PERCEPTIONS OF THE PROGRAM 

There is a great deal of university competition in the North Texas area. Unlike 
some programs for bilingual e du cation that experience little or no growth, East 
Texas State University undertook careful monitoring of the services rendered and 
the programs and courses offered in order to maximize its enrollments and, thusly, 
better serve the needs of bilingual children in its catchment area. One indica- 
tion of its success was noted earlier - in the period following 1981, many North 
Texas universities experienced a decrease in student enrollment but the bilingual 
education program at East Texas State University maintained its numbers , 

A part of this monitoring system at the East Texas State University Title VII pro- 
ject was specific to the participants in that program; the University also conduc- 
ted evaluations across all colleges, adding emphasis to its concerns. The general 
University and the Title VTI evaluations protected the confidentiality of the docu- 
ments submitted by the students and the information on courses, thereby professors 
was equally protected. ' 

Too, the student evaluations were voluntary, although every effort was made to as- 
sure them of the anonymity of their responses; the replies varied somewhat over 
the years, starting at about 707, and thereafter rising to nearly 90? o for most of 
the program years. 

The degree programs, as set out in the introductory section, included the full 
range of subject matter courses, persuant to the University's objectives of fully 
preparing good teachers, not just in bilingual methodologies. Those inclusions, 
however, meant that because of *"he selection of many majors and minors by the 
students, at times only a very few were enrolled in a course. These small nuabers 
made it statistically impossible to examine every course across the years for this 
final report although the interim reports , submitted confidentially to the direc- 
tor, contained that information so that adjustments could be made, when possible, 
to improve the program offerings. The present document, therefore, examines the' 
course perceptions via generalized subject matter, useful in itself in making cer- 
tain judgments about the students * participation and acquisition of skills and Of 
knowledge . 

The services persisted across the eight years of Title VTI funding, and for the 
most part, continue beyond it. Some variation in funding in different years va- 
ried the amount that could be rendered. Professional speakers, for example, now 
charge _ substantially more than in the early years; that, plus soma reduction in 
that line item, made it impossible to supply the number utilized earlier. As 
will be seen, however, the student perceptions of the services appeared to have 
concentrated on quality rather than quantity, 

Perceptions of Services 

Degree design was seen as a service since it implied a set of advisory, counsel- 
ing, and assistance services to the student. The design is developed over a peri- 
od of time, thus the annual evaluations would be expected to be modified as the 
student perceives its growth and implementation. The anxieties about the design 
are evident as the students first enroll, rating it somewhat lower, and then in- 
creasing the positiveness as they proceed through the processes. 

Table 5 displays the design perceptions across the eight years. Note the lower 
mean at the beginning, about midway between fair and strong, and then the gradual 
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increase through 1980, a small dip as many new students entered in 1981, and 
a rise thereafter. 



The ratings _ for the last two years , well above the strong level , and higher than 
in any previous period. Some of the professors were new at the beginning of the 
project, some of the processes were not yet finalized because of negotiations with 
the accrediting authorities , and the general new student worries over a degree de- 
sign, contributed to the considerably lower perceptions during the first few years 
Regularized procedures and high quality advisement no doubt accounted for the very 
positive ratings the last two years. 

Table 5: Rating Frequencies and Calculated Composite Means on the Degree Desien- 
1976-1984 6 ^ ' 



Rating Category* 


1976 
% 


1977 

% 


1978 

% 


1979 
7o 


1980 

% 


1981 
7o 


1982 

% 


1983 
7c 


1984 

% 


Very strong 


8 


9 


10 


6 


18 


14 


16 


25 


26 


Strong 


32 


37 


47 


53 


51 


41 


51 


51 


53 


Fair 


48 


43 


39 


30 


27 


16 


8 


10 


9 


Weak 


1 


1 


1 


2 


1 


2 


0 


0 


0 


Very Weak 


0 


0 


1 


0 


0 


0 


0 


0 


0 


No response 


1 


0 


2 


10 


3 


27 


35 


12 


12 



Composite Rating** 3.17 3.24 3.62 3.72 3.88 3.71 4.08 4.12 4.19 

* Very strong=5; strong=4; fair=Z; weak=2; very weak=l. 

** No response was eliminated from the calculation of the composite mean. 

The 1982, 1983, and 1984 composite means were not statistically different among 
themselves. All three, however, were significantly higher (.01) than 1981 and 
still higher (.001) over the first three years. The degree design is a compli- 
cated process but the students saw improvement across the years. 

The program evaluation also measured perceived changes in Spanish fluency from 
the beginning. During the first six years, the students consistently rated their 
proficiency as higher at the end of their programs than at the beginning. The in- 
flux of students interested only in the ESL endorsement , in which Spanish was not 
a requirement, reduced the comparability daring the last two years and they thus 
are not reported. 

The number of undergraduates and the ESL teachers new to the program lowered the 
proportion of those who coula judge the liaison services to the schools and teach- 
ers. Despite this difference, which because of limited numbers could easily have 
resulted in lowered appreciation of that service, the ratings remained remarkably 
stable across the years - between effective and very effective. (Table 6) That 
is, those who knew the program rated it quite high. 

Few evaluator observations of the liaison visits were conducted during the monitor- 
ing due to the press of time. Interviews with the participants and with some of 
principals were utilized in this regard. Their comments ranged widely in content 
depending upon the nature of the assistance furnished, but their qualitative judg- 
ments were much like those they gave in the written ratings : it is a worthwhile 
project component. The liaisons were experienced professionals and the advice and 
help they gave the students was appreciated. Principals were even more positive. 
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Table 6: Frequencies and Composite Ratings of the Liaison Services: 1976-1984 



Response Category* 


1976 

7 


1977 

7 


1978 

7 

/o 


1979 

7 

to 


1980 
7 


1981 

/o 


1982 

to 


1983 

°i 

A> 


1984 

U 


Very effective 


11 




14 


16 


20 


16 


17 


]/• 


16 


Fairly effective 


13 


13 


13 


27 


27 


4 


10 


8 


10 


Not effective 


4 


3 


3 


4 


6 


0 


0 


0 


0 


No response/Not observed 


72 


72 


70 


67 


47 


80 


73 


78 


74 



Conposite Rating** 0.9 0.9 1.0 1.4 1.3 1.3 1.4 1.4 1 ; 4 

* Very effective=2j effectived; not effectives. 

** Not effective was used in the calculation of the composite rating but the no 
responses were excluded. 

In earlier years, the evaluation included the consultant services portion of the 
project. The general reduction of funds caused to be considerably reduced but, 
as was noted in an earlier context, almost all the students rated them as very' 
effective, regardless of how many there were. 

During the first seven years, the project included funds for a news organ, called 
Boletin, that contained information on state certification requirements , reviews 
of state and federal legislation, articles by students and faculty, and course 
offerings at the different sites. It had wide distribution to schools, districts, 
and students; additionally, bulletin board copies were sent to the other universi- 
ties . This latter was particularly important because students within the North 
Texas Federation could apply courses from one university to their programs in 
others . The eighth year funds did not provide for its production and distribu- 
tion and that lack was sorely lamented by everyone concerned. 

Two other service conponents ware always rated very highly by the participants : 
the library holdings and the curricular materials held in a special collection. 
The comments noted the convenience of the service (professors carried materials 
to the classes away from the home campus in the early years but they were later 
made more available through the library at the Satellite Learning Center) . Gra- 
duate students felt the services to be especially helpful since the library hold- 
ings facilitated their research and the teachers were able to make direct use -of 
the curricular materials in improving their classroom teaching. 

Although mostly covered in the section on institutionalization, the services to 
other organizations are mentioned again because of their importance . East Texas 
State University was especially active in aiding the Texas Education Agency, that 
entity's Regional Service Centers, and the Dallas Evaluation and Dissemination 
Center. While they were of little cost to the project, they amounted to substan- 
tial assistance in the development of the regularions, degree and endorsement pro- 
grams, and the training that was authorized. The materials produced are widaLv 
used throughout the area, and in so far as the p'-oject contributed to their devel- 
opment, stand as solid achievements of the ESEA Title VII Bilingual Education pro- 
ject at East Texas State University. 

Services, then, were a vital component of the project. Bilingual education, and 
later, English as a second language instruction, were new to the area. The strong 
contributions of the project, and the University itself, to the articulation of 
them represent worthy federal investment. 
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Perceptions of the Instruction 



The East Texas State University ESEA Title VII project emphasized the 
of the delivery of the instruction to the students. The provision of materials, 
professors experienced in bilingual education, and assistance on both of these so 
that the e-rvir-Ament would maximize the intended effects . Greater learning by 
the students , who were or would become the teachers and specialists in the dis- 
tricts, would benefit the pupils in the bilingual classrooms. 

University systems are such that a special project cannot demand changes in the way 
courses are taught; it can only offer assistance and suggestions so that those who 
want to improve can do so. Individual professors are jealous of their courses and 
sometimes resist modifications that might make their work more acceptable to stu- 
dents, reasoning that their subject matter is more important than what the stu- 
dents think. Too, circumstances do not always permit a university the ideal 
choice for an instructor in a particular course. East Texas State university con- 
tinually worked toward the long range goal of improved teaching, both by offering 
assistance to and by choosing the best personnel it could find. Several of the 
professors always asked for the ratings on their courses, discussed the comments 
with the evaluator, and made sincere efforts toward improvement. They were, by 
and large, successful, and the ratings improved over time. 

However, some subjects, in and of themselves, were less well received, and the ra- 
tings tended to remain low or toward the middle of the range. Some of these invol- 
ved an unusual amount of outside work, some were more theoretical than practical, 
and in other cases , the students simply did not like or appreciate the courses . 
The perceptions also varied a grpat deal among the students, sometimes ranging from 
very low to very high, as would be expected among a large number of students; this 
was most often true for undergraduate courses than for graduate, and tended to be 
more frequent on basic rather than courses in the students' majors. 

Nevertheless , the University insisted that student perceived information about the 
courses and the program as a whole be -m input to the improvement of the project 
and its other services as well. The continuous experience of the evaluator with 
the program demonstrated improvement could be achieved. 

General Program Opinions 

Each student was asked to c cement or make suggestions about tiow the program was 
conducted. Over the years, but in lesser quantities each year, they expected that 
the professors would use more Spanish in the classes. The amount of Spanish, of 
courses , was in part dictated by the proficiency of the professor and in part by 
that of the composition of the class . The suggestions did note differences but 
still indicated their own concerns for greater fluency in Spanish and the recogni- 
tion that its utilization in the classes would help them improve. Two divergent 
evidences of this concern were frequent complaints that an undefgraduate Spanish 
course was conducted almost entirely in English, and the reverse, substantive com- 
pliments about a graduate Spanish course always taught almost exclusively in that 
language. 

The second type of comment was that engendered by perceived improper conduct of a 
course. While these were infrequent, and often improvement was demonstrated later, 
these should be noted for other programs. Examples of these included: 

c Students expected that Spanish would be the dominant language in a 
Spanish course, as previously noted; they objected strenuouslv when 
it was not. 
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o Both Mexican Americans and non-Mexican Americans objected to dispara- 
ging remarks about Mexican Americans and/or about their Spanish. 

o A few non-major undergraduate courses were the subjects of almost con- 
tinual criticism; the grading systems, lack of explanations, and "un- 
caring" professors encompassed most of these. 

o Most of the graduate courses, especially those on Spanish, enjoyed very 
favorable comment throughout the eight years. 

o Professional maturity was evidenced in comments about some graduate 
courses that emphasized the "civil rights" aspects in detriment to the 
practical content. 

0 Except on rare occasions, the main bilingual and ESL courses, whether 
graduate or undergraduate, were positively received. 

It should be enphasized that the relative difficulty of a course was not a factor 
in the students' ratings. For example, the gradua t e Spanish course ccmnantT often 
combined the judgments of "hardest course I've had" and "best course of all." As 
will be seen in the next section, the traditionally difficult courses of mathema- 
tics and science were as apt to be rated highly as some seen as "easier." 

Positive conments and worthy suggestions always far outnunfcered those that were 
negative. Most students at least appended a note about their learning, the uti- 
lity, and the conduct of the courses. Typical of the suggestions were: 

. . . this course should be offered at the beginning of the Masters 
program. . . 

... I learned more about writing and improving my presentations though 
this research course than in any other . . . 

... is to be congratulated for the finest course ever presented in this 
or any other program in which I have been enrolled. . .offer another. . . 

. . .nowlwant more; a followup course or courses on Spanish granmar and 
composition would greatly improve this program. 

. . . this history course taught me more about myself and my people than 

1 thought possible. . .please make a followup course available. 

... at least I understand now what a research paper or article is saying 
and not saying. . . more. . ! 

. . . focusing homework on the production of materials directly related to 
my teaching gave me much better insights into the subject than routine 
theory repititions would have. 

. . .more sociology. . .it helps me understand the little things. . . 

In general, then, both the program design and its conduct, as seen through the eyes 
of the participants, showed a steadily iinproving rating across the years. Many of 
their suggestions were put into practice. Several professors substantially im- 
proved their courses. 

Course Ratings 

The ratings on every course were submitted with the number of students rating it 
to the director every year, in confidence, to enable him to talk with professors 
or otherwise attempt improvements. The annual reports, however, were couched in 
general terms so that the professors could not be" identified. As would be antici- 
pated , a few students took a very wide variety of courses ; these were often too 
few to make the ratings representative of the subject or its conduct. In order to 
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maximize the information, courses with three or more ratings in any quarter were 
grouped into general subject areas. These are presented in Table 7 for the eight 
years of the grant. 

NJIE particularly that the intervals on the rating scale and the direction is dif- 
ferent on the course ratings than in the previous tables . The direction was re- 
versed so that very 8tvong=l s stvong=2 i fair^Z, weaV=4, very weak=S. The lower 
the mean rating, the more positive it is. 



Table 7: Comparative Overall Ratings by Students of the Courses Taken to Fulfill 
their Degree Requirements : 197b through 1984 (mathematical means*) 



Course Areas 


1976 


1977 


.1.7/ o 


1 979 




1701 


iyoz 




t no/ 
1984 


Language 




















English, undergraduate 
English, graduate 
Spanish, undergraduate 

Linguistics 


1.91 
1.48 
3.87 

3.44 


1.92 
1.48 
3.88 

1 on 

1 . 4- J 

3.44 


1.99 
1.45 
3.87 

1 . lO 

3.52 


1.81 
1.44 
2.92 

1 . Zl 

3.00 


1.85 

1.37 

2.76 
t on 


1.84 
1.38 
2.86 

l.ZZ 

3.06 


1.85 

3.33 
1.22 
3.02 


1.33 
1.33 
2.06 
1.24 
1.24 


1.35 
1.33 
2.81 
1.20 
1.22 


Education 




















Elementary, undergraduate 
Elementary, graduate 
Secondary unders"radiaaf"e 
Administration 
Research 


2.36 
2.04 
1 97 


2.39 
1.97 

2.07 


3.00 
2.00 

1.54 
1.97 


2.32 
2.12 

1.50 


2.51 
1.90 

1.51 
1.86 


2.44 
1.87 

1.0/ 

1.50 
1.54 


2.50 
1.62 

1. DO 

1.50 
1.34 


1.97 
1.58 
1.5U 
1.38 
1.34 


1.88 
1.56 
1.49 
1.30 
1.33 


Social Sciences 




















History 

Political Science 

Psychology 

Sociology 


2.33 
2.67 
1.77 
1.45 


2.20 
2.68 
1.90 
1.50 


2.21 
2.54 
1.88 
1.51 


1.97 
2.60 
1.68 
1.67 


1.54 
2.80 
1.55 
1.35 


1.56 
2.37 
1.55 
2.20 


1.45 
2.50 
1.45 
2.25 


2.00 
2.50 
2.00 
3.00 


1.87 
2.51 
1.67 
2.80 


Math/ Science** 




















Mathematics 

Biology 

Botany 

Earth Sciences 


160 
1.61 


1.63 
1.62 


1.63 
1.80 
2.45 
1.18 


1.70 
1.40 
2.50 
1.24 


1.60 
1.44 


1.81 
1.50 
2.45 
1.26 


1.80 
1.50 
2.83 
1.00 


2.00 
1.75 

1.00 


1.63 
1.58 

1.16 


Others 




















Computer Science 
Physical Education 






2.75 


1.24 
2.77 


1.32 
2.80 


1.00 
2.82 


1.00 
2.75 


1.00 
2.75 


1.00 
2.89 



* The students rated each course on six variables: content, methods, grading sys- 
tem, tests, learning, overall; the mean utilized in this table is a calculated 
mean from the six variables. 



** These were all undergraduate courses except for a fey reports on statistics ard 
earth sciences, 
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The University and the project's efforts to improve the instruction gave results. 
On some it took a considerable amount of time but others were modified quickly. 
The major information from Table 7 includes: 

English: Both undergraduate and graduate courses started near the "strong" 
rating and moved close to the "very strong" by the end of the period. 

Spanish: Undergraduate Spanish was a continuing problem, starting at a 
"weak" rating but improving to "fair" except one year in which it was 
at "strong." Graduate Spanish, on the other hand, began very near 
"very strong" and continued there throughout the eight years. Graduate 
Spanish consistently enjoyed the higjiest ratings of the specific project 
courses. 

Linguistics began low and showed little improvement until the last two 
years; in those two, it was rated near 'very strong." 

History began below the "strong" category, showed some increased appreci- 
ation for four years, and declined slightly. 

Political science stayed roughly the same, between "fair" and "strong." 

Psychology did not vary much, hovering around the "strong" rating. 

Sociology was the only grouping that . deteriorated across time. 

Mathematics and biology were quite consistently between "strong" and "very 
strong"; botany about a point below that; earth sciences were always the 
highest of the science courses. 

Computer science started high and the last four years received a unani- 
mous "very strong" indication. 

Physical education remained toward the "fair" side every year. 

Elementary education, for graduates and undergraduates, started about 
"strong" and improved through the years, with graduate courses showing 
the highest increase. 

Secondary education was quite consistently toward "strong" the whole time. 

Administration courses began and ended midway between "strong" and "very 
strong" and kept that appreciation. 

Research in education (occasionally in another area) was initially at 
"strong" but in the last three years was nearer to 'Very strong." 

Although the project began its ratings of the courses from the very beginning, 
the University did not press its student evaluations until 1982. Since most areas 
showed improvement from about that point on, it is probable that the combination 
of the evaluations worked together for still greater improvement than hid already 
been begun. 

It is clear, however, that project influence resulted in improvement, especially 
when the professors were concerned, asked for their ratings, and discussed them 
with the project director and the avaluator. In a few cases, remarkable improve- 
ment was made in a ohort time. Others required the eventual change of personnel 
to effect. One element that modified the ratings at times were the adjunct pro- 
fessors. Oily one continued throughout the eight years and her ratings were con- 
sistently among the best in the study. Others were contracted for courses when 
the load was too great for the regular professors; while intensive reviews were 
conducted in their recruitment, some were much better than others. Project per- 
sonnel served better the interests of good instruction, incl udin g the one long 
term adjunct, than did the casual employees. 
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A SEPARATE FOLLCWUP SURVEY 



The East Texas State University ESEA Title VII Bilingual Program has carefully 
evaluated its important phases throughout its eight year life, obtaining the 
opinions and suggestions of students annually. These, in turn, have been compu- 
terized to allow for trends across the years. The mass of data, considerably 
attenuated during the past two years because of costs and utility for the pre- 
sent, have allowed many modifications in the operation of the program and, as 
seen in the earlier sections, a great deal of improvement. Indeed, the annual 
evaluations in recent years have shown the program to be strong in its component 
parts, 

Not content with always viewing present- time data, the project decided to conduct 
a followup survey, apart from the regular annual evaluation, that would allow the 
past students, as well as those currently enrolled, to express their opinions and 
give suggestions for still further improvement. The suggestions of past students 
were accorded greater merit since they were no longer directly affiliated with 
the University and were employing what they had learned there, or feeling the 
lack of learning, in their positions. 

Two approaches were taken to the survey. First, the program secretary undertook 
to contact all the previous students that had completed one or more semesters 
under funding from the ESEA Title VII project. The basic information on their 
present occupations, whether utilizing bilingual skills or not, and their cur- 
rent addresses. The second approach was that of mailing out a survey form to 
those for whom addresses could be verified; some, of course, had moved and left 
no forwarding address and could not otherwise be located. This was especially 
true for the first three years of the project; incomplete records also hampered 
the search for some former students. 

The total possible former students was 163 for the period that could be verified. 
However, 24 of these could not be located, leaving 129 potential respondents. A* 
summer mailing, necessary under the circumstances but always deficient for find- 
ing teachers, resulted in a return of 50 instruments; 48 more were returned in 
late fall 1984. 



The instrument, presented in Appendix C, contained many similar elements to that 
used for the annual evaluations. To allow for separate calculations of the da- 
ta, present from past enrollment was contained as an introductory item. Exactly 
half was enrolled at the time the survey was answered. Their present/past exper- 
ience since enrollment, whether the experience involved bilingual or ESL, was re- 
quested. The possession of bachelor, masters, or doctorate degrees, whether they 
were obtained at East Texas State University or elsewhere, and a category for 
those that took only a few courses at the University checked that portion of the 
educational experience. Similarly, possession of the bilingual and other certi- 
ficates and where they were obtained furnished valuable information. 

An opinionnaire section followed, seeking the participants' judgments about the 
several subject areas in their studies at the University, as well as their en- 
dorsement/certificate and degree programs. Finally, they were asked to rate 
their East Texas State University program as a whole. Equally important with 
the ratings, the respondents were asked to add any comments about each opinion 
component, explaining their ratings or offering suggestions. 

The forms were forwarded to the evaluator, who nalyzed the answers and Prepared 
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the present report. A provisional report was submitted on the survey in fall 1983- 
cne present is an update of it on cne 99 students (777, of the potential) . 

Characteristics of the Survey Participants 

The direct contact survey by the program secretary produced both primary (discus- 
sions with the former student) and secondary (information from other sources) 
data on them. Slightly over 89% was employed in a bilingual setting, teaching 
or in seme other way, serving the bilingual populations of their schools, dis- 
tricts, and universities. Some, of course, had been promoted to non-classroom 
positions but in any event, they were still concerned with children speaking lan- 
guages other than English. The East Texas State University has, then, admirably 
served its principal purpose of adding to the resources available to limited and 
non-English speaking children. 

The remaining 11% was in a variety of positions, mostly those of teaching in 
a regular, full English classroom. Oily three persons were in non-education po- 
sitions, all in business requiring no Spanish in their opinion. 

The mail form respondents, as noted previously, contained some currently enrolled. 
Many of these, however, were also teaching or working in other positions at the 
same time. The declared occupations (Table 8), showed only 9% to be full time 
students. six percent was in business in one form or another. 



Table 8: Occupations of the Responding Survey Students 



ERIC 



Occupation 



Percent 



Occupation 



Percent 



Elementary teacher 
Secondary teacher 
Aide 

Volunteer/ subs titute 
Adult/ college 
Administrator 



56 
9 
2 
3 
3 
4 



Instructional specialist 
Education writer 
Curriculum coordinator 
Business 

Bilingual secretary 
Student 



2 
2 
3 
5 
1 
9 



* One person did not respond to this question. 

Of those who were not teaching at the time of the survey, 14% had ta jght since 
completing their studies at the University. Totalling those now teaching with 
those that had in the past, at least some of that experience was bilingual, 
74%, and/ or ESL, 43%. The undergraduate students, seme, of whom had taught' 
anr* some had not, complicated the separation of them from the results of this 
question. 

Eighty-nine percent of the respondents had already achieved the bachelors degree; 
tnirty-six percent had obtained it frcm East Texas State University. The large 
nouiDer ai masters students, plus those from other Federation universities who 
came in for special courses or the certificate program, accounted for the others. 
This is emphasized in the percentage with masters degrees - 38% - three-fourths 
frcm this University. Oily two doctoral students replied; one had received the 
degree from East Texas State University and the other elsewhere. 

Sane thirteen percent noted they had taken only a few courses at East Texas 
State University, mostly these were Federation students. 
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A major goal of many students in the program is the acquisition of the bilingual 
endorsement to the elementary teaching certificate. Three avenues were open to 
them: 1. complete all the requirements at East Texas State University and be re- 
cccmended by that institution; 2. apply directly to the Texas Education Agency 
receive a deficiency plan if they lacked any of the requirements, conplete those 
at a university, and then submit the transcripts to the Agency; 3. participate 
in a district preparation program and take courses at a university, and be re- 
commended b y the district when the requirements were met. Forty- four percent of 
2* Respondents had already achieved that goal; 40ft had done so' directly through 
tne Title VII program, the others taking some courses at East Texas State Univer- 
sity and submitting the transcripts to districts or directly to the Agency. 

Students who planned their degree programs accordingly, or who had the necessary 
transfer courses, were able to obtain other certificates or endorsements as well. 
Those attained by the respondents included: elementary (7) , kindergarten (4) 
supervisor (3) , special education (2) , mentally retarded (1) , Spanish (2) , and 
ESL (2) . The latter will, of course, increase substantially during the next 
few years. 

In general, then, the respondents represented the program participants for the 
years encompassed. Obviously, the responses from the earlier years were few; 
their changes of residence made contacting them more difficult. The combina- 
tion of undergraduate and graduate students, the different degree and certifi- 
cate programs, and the conditions of the bilingual education prograns in the 
districts were reflected appropriately among the Title VII participants . 

Course Grouping Judgments 

As noted at the beginning of the survey section, it was expected that those who 
had completed their work at the University and while in the profession had s ans 
opportunities to judge the program components more objectively, might rate their 
courses and degree designs differently than those still in school. That was 
true, however, in only one case; the graduate students no longer in school judged 
the Spanish courses even higher than did those now enrolled. The mean ratings 
for all other program elements were not significantly different when separated 
by former and present students. (See Special Note to Table 9.) 

Table 9: Mean Ratings of the Survey Respondents on the Program Course Groupings 



Course Grouping 


Mean 


Course Grouping Mean 


Spanish* 

English 

Social studies 

Mathematics/science 

Bilingual methods 


4.41 
3.77 
3.77 
3.48 
4.11 


ESL methods L . 04 
Other language methods 3 .73 
Social/multicultural methods 4.30 
Methods for other subjects 3.98 



* Tne mean for former graduate students was 4.87; undergraduate students, whe- 
ther present or past, was 3.98. 

SPECIAL NOTE: In the sections of the annual evaluaticK, the rating scale was in 
yr-jcrse polarity with l=vcr}f strong and &=-jery -Jejik. In the trurvcv, 5=veru 
strong^ 4=strong, 5= fair, 2=weak, livery weak. r>:e cJiange was intentionally made 
ir. 'vrrii routine replies. AV r^sronirni cor.- r :,rsi the scale" 
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Spanish enjoyed the highest rating of any course grouping, one-third higher than 
strong. There were also more comments appended to this item than any other The 
majority of these were summary statements about the excellence of the courses. 
All the other directly positive notations ccnmended the graduate Spanish profes- 
sor for her knowledge, methods, and ability to motivate the students. Two gra- 
duate students recommended more practice and instruction on writing Spanish and 
two requested more courses on the language. Five undergraduate students repeated 
the complaints tfat have been nearly constant through the years: Spanish courses 
taught in English and one professor that ridicules Mexican Americans' Spanish. 

The social studies /multicultural methods courses received a rating almost as high 
as Spanish, 4.30, again a third above the strong rating. Few conments were re- 
gistered: one ccnmended a workshop on multicultural methods as the best ever ta- 
ken; two suggested that more courses be taught on this subject and that how to 
teach awareness of multicultural strengths would help the teachers. 

The bilingual methods courses also received a better than strong judgment, 4.11 
Seme general statements about the utility and relevancy of the courses were in- 
cluded and one praised the staff highly. The only complaint was that the respon- 
dent felt that more writing methods should have been included. 

The ESL methods courses also merited a strong rating, 4.03, and the second lar- 
gest nunber of comments within this group; all from graduate students. The 
necessity and relevance of the subject were observed by eight respondents. Four 
made general positive statements about the work. One noted that the opportunity 
to find out what other teachers were doing was of special practicality. Two felt 
that the professors needed more elementary classroom experience and another noted 
that the information was mostly for elementary teachers and dwelt little on the 
teaching of ESL in secondary schools. 

All the other subject groupings were judged between fair and strong. "While only 
a few weak and no very weak ratings were marked in this survey, almost all of 
the weak judgments were given to this group. That is, there was a wide variation 
in the ratings, not unexpected since many professors were involved across the 
years. Too, few conments were appended to the items covering these course group- 
ings; these tended to be specific statements, mostly negative, about particular 
professors. 

In any survey of this type, there is always the concern that those feeling more 
positive toward the program and courses would be more likely to conplete the 
form and return it. A comparison of the course ratings with those of previous 
years suggests that this did not happen. Undergraduates judged the courses al- 
most exactly as they had each of the past three years. Graduate student ratings 
tended to be more positive than previously but their time away from the Univer- 
sity probably explains that differential. When enough comments were included, 
such as was the case for Spanish, English, bilingual and ESL rrethods, thev sup- 
ported the ratings given. No systematic biases could be ascertained frotn the' 
examination of the survey with the annual ratings. 

Program Judgments 

Three general program ratings were sought in the survey, two specific to the pro- 
ject (endorsement/certificate and degree designs) and one probed the overall East 
Texas State University experience. Almost no comments were appended to the ra- 
tings of the endorsement /certificate programs but the general University exper- 
ience item brought a host of conments, both specific to the University and 
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to the courses, professors, and other program components. A few cocmented on the 
degree design. 

The endorsement/certificate programs received an almost exactly strong rating, 
3.93, and there was little variation among the respondents; an almost equal num- 
ber judged them fair, strong, and very strong. Since there were no cccments, no 
analyses of the differences could be made. 

The degree design was given a higher rating, 4.08, just above strong. The few 
cannents indicated that the students involved in transfers to other universities 
had experienced seme difficulty. Che complained generally about the Federation 
regulations, another said that acceptable courses to other Federation universi- 
ties should be more clearly marked (one course did not transfer) . The favorable 
cannents centered on the excellent advice that had been given. 

The general East Texas State University experience judgment was strong, 4.11, in- 
dicating a considerable satisfaction. No difference was found between the ratings 
of former and present students. The positive cannents praised the availability of 
professors for conferences, the quality of that advice, and that the University 
takes an interest in, cares about, students. Five also made specific reference 
to the bilingual program staff as very helpful to students. Two noted that they 
had attended other universities and that the East Texas State University experi- 
ence was the most rewarding of any. Oily two negative context cccments were in- 
cluded: seme professors are prejudiced against Mexican Americans, and that in 
seme curriculun courses, there is too much busy work and not enough content. The 
preponderance of cormendations for the University experience was a strong feature 
for the University and for the Title VII project. 

The survey form was designed to be folded and mailed, free of charge, back to the 
program office. That procedure left one third- of the back without items for the 
respondents. Nevertheless, 51 (527 0 ) utilized the space to add other cccments. 
Some of these were reiterations of what had been sai 1 about the courses or the 
program: high praise for the graduate Spanish course and professor, accessibili- 
ty of the professors and program staff, and special cccmendations for some other 
professors. Seven cccments assessed the use of Spanish in the methods courses 
as very important to becoming truly bilingual; one noted her acquisition of pro- 
fessional vocabulary from that component. 

Five participants utilized the space to make suggestions about the survey instru- 
ment . Four noted that some of the course groupings encompassed many courses in 
many departments, taught by many professors, and that the variation among them 
made it difficult to arrive at a rating. Social studies was given as an example 
in which one participant stated he would have rated some specific courses very 
weak and others very strong, thus he had to settle on a fair rating, which thus 
masked the reality of the situation. No doubt others experienced the same diffi- 
culty even though they did not express it as directly. 

Four former students utilize^ the space to compliment the Title VII Bilingual 
Studies program for conducting the survey. All four noted they had studied at 
other institutions and had never been asked to make judgments about them. They 
felt the survey was an indication of the project and University concern for its 
students. Eoch also expressed an interest in knowing about the results; since 
the surveys were anonymous, camrunicating directly with them is not possi- 
ble. An announcement about where and when interested persons might view the 
results would be appropriate. | 
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REPORT SUMMARY 

iSf 5 ^ iv ^ s i t y ESEA Title VII Bilingual Education project began 

.Jrir i? 76 m * continued through summer 1984, eight years of Federal and Univer- 
sity runding and with some supplemental monies from the Texas Education Agency 
The goal of the project was to improve the education of limited and non-relish 
speaking students in the North Texas area schools. To reach that goal the pro- 
gram specified objectives related to the training of new bilingual teachers (un- 
dergraduates) , of teachers already in service (masters program) , administrators 
and specialists (post masters and doctoral levels) . 

The project insisted that all trainees be fully qualified as regular teachers and 
administrators, thus taking the full range of subject matter, teacning/administra- 
tive methodologies, and that the bilingual and multicultural education be added as 
required for specific bilingual degrees and/or the bilingual endorsement to the 
Texas certificates. English as a second language was added first as a subject and 
later as a degree and certificate endorsement objective. Nearly 400 participants 
were in the program; some took only a co irse or two as needed in other North Texas 
i-ederation universities, seme only completed their certificate requirements • 129 
completed the degree programs. * ' 

Measured proficiency in both English and Spanish was required of all recommended 
certificate and degree participants. To aid in its accomplishment, the University 
ottered undergraduate and graduate courses, provided a language laboratory and 
conducted as many of the classes as possible within a bilingual environment The 
program began in conjunction with the Dallas Independent School District and later 
extended the collaboration to many others. Courses were offered regularly on the 
heme campus at Commerce and in the Satellite Learning Center in the Dallas Metro- 
politan Area, as well as some in other districts. The main professors were fully 
qualified for University status and were part of the system; additionally they 
were bilingual, experienced in bilingual education, and had produced worthy mate- 
rials and/or research in the field. 7 

Most of the professors were placed into the regular tenure track or were already 
in it. Seme adjunct professors were needed for peak load periods- only one ad- 
junct professor worked continuously through the eight years. Institutionalization 
or the staff, then, was unusually high; further, the full integration of the de- 
gree and certificate programs was effected through the regular University and Tex- 
as Education Agency channels . Profess ionalization was also strong with the staff 
producing books, papers, and articles through the period. Cooperation with other 
universities and agencies was likewise sound , lending professional support in many 
ways, especially to the Texas Education Agency, the North Texas Federation of Uni- 
versities, the Dallas Evaluation and Dissemination Center, and the Regional Service 
Centers. The staff was active in the Texas and National Bilingual Education Asso- 
ciations, as well as societies for foreign languages and their teaching All of 
the professors received at least one promotion and most were named as graduate fa- 
culty; they served on a wide range of University committees and advisory groups. 

Ail eight years were evaluated externally and internally. The processes were moni- 
tored, student progress charted, and participant perceptions of the program the 
processes, and the courses were measured annually and compared longitudinally as 
the students proceeded through the program. Interim quarterly reports were tended 
annual summaries submitted, and conferences with University administration pro- ' 
ject administration, professors, and participants added the contextual dimensions 
The present report includes the information on the eighth year, 1983-1984 and the 
.sunrnar^ation of the entire period. ' 
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Further, the project conducted a followup survey of former participants, beginning 
in suamer 1983 and terminating in late fall 1984. A brief presentation of the re- 
sults is also included in this final report. 

Across the eight years , the degree design was seen in a more and nore positive 
view, beginning between what was termed "fair" and "strong" but by midway was a 
fully "strong" rating. Liaison services to students and their schools was seen 
as fairly effective to very effective. Consultant seminars and conferences were 
judged very helpful , even when the funding for them was lowered and few could be 
held. 

As a whole, the program was rated between "strong" and 'very strong," and improved 
markedly after the first few startup years. The courses were considered carefully 
by the participants and their ratings varied a great deal. Some undergraduate of- 
ferings, especially in Spanish, received low marks; interestingly, these were rare- 
ly the courses considered difficult - science , mathematics , Egnlish were as apt to 
receive high ratings as those from any other field. Undergraduate elementary edu- 
cation course generally enjoyed "strong" ratings and some improvement was seen 
across the eight years. Graduate courses were almost all viewed very favorably , 
usually between "strong" and very strong." Graduate Spanish courses and computer 
science courses were rated nearly or at the "very strong" level. 

The followup survey resulted in 99 replies ; difficulties with persons moving and 
leaving no forwarding address kept this number to about 77% of the potential. A 
study of the students participating in the program and responding to the survey 
showed near coincidence. Mare than half was elementary teachers; the others were 
scattered through secondary, adult, college, administration and auxilliary ser- 
vices, and business. Almost all of the graduates taught bilingual or ESL educa- 
tion during their studies or following them. Mexican Americans made up nore than 
half the students; other Latin Americans and Anglos made up the majority of those 
remaining. Just over 50% of the participants already had teaching experience, 
most in regular and bilingual education. About 89% reported they had achieved 
the BA, MA, and/or PhD during or just after their participation. More than 93% 
obtained either the bilingual or the ESL certificate endorsements. 

The past students that replied to the survey rated the degree design, the program 
as a whole, and many of the courses as 'Very strong," thus raising their estima- 
tion with the added experience after completing the program. They remained dis- 
cerning, however, and showed less appreciation for some courses at the graduate 
level and more at the undergraduate level, especially undergraduate Spanish. 

An important aspect of the annual evaluations and the followup survey was the will- 
ingness of the participants to offer positive conments and suggestions. Indeed, a 
general reconmendation after one graduate Spanish composition course, was that more 
grammar and writing should be included; the program was modified to offer them. 

In general review, then, and when compared to other Title VII training programs, 
List: Texas State University was far more successful in institutionalizing the pro- 
ject into its regular system; heavy work loads did not keep the staff from produc- 
ing, studies and other publications, nor in participating fully in University and 
ccnmunity activities . The program was seen by the students as worthwhile and they 
were, for the most part, successful in gaining their degrees, certificates, and 
abilities necessary to teach bilingually and in English as a second language. The 
federal ESEA Title VII funds were well spent on this project with East Texas State 
University. 
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APPENDICES 

A: Annual Student Evaluation Form 

B: Participant Followup Survey Questionnaire 
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EAST TEXAS STAIE UNIVERSITY BILINGUAL TRAINING PROGRAM 
Instructional Evaluation 

Ihdergraduate , Masters , Post Masters , Doctoral^ 

1. Present Occupation: 

__Teacher, grades 1-3 ^Administrator __Other, please specify: 

^Teacher, grades 4-6 Aide 

Teacher, grades 7-12 Student 

2. Total Teaching Experience: 

None 3-5 years 

Less than 9 mo. 6-10 years 

1-2 years 11 or more 

3. Total Bilingual eaching Experience: 
_None 3-5 years 

Less than 9 mo. 6-10 years 

1-2 years 11 or more 

4. Male Female 

5. Ethnicity: Mexican American_, Black , Anglo , Other (specify): 

6. Do you have the bilingual education endorsement? Yes , No 

7. If yes, was the endorsement obtained through: EISU , district , other uni- 

versity 

8. I am receiving Title VII funding for this program. 

I am paying my own fees . 

I am receiving other than Title VII funding. 

WHAT SUGGESTIONS DO YOU HAVE FOR IMPROVING THE FOLLOWING? (Use back if needed.) 

1. Language program 

2. Culture program 

3. Teaching methodologies 

4. Research 

5. Looking at your degree program as a whole, and from what you can tell at this 
point, how would you rate it? 

very weak, weak, fair, strong, very strong 

. . .continued. . . 
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6. How would you rate your fluency in Spanish at this point in the program? 

__very fluent, fairly fluent, _know some Spanish, _know nearly no Spanish 

How would you rate your writing in Spanish? 

__very fluent, fairly fluent, __can write some, __can write very little. 

7. How would you rate the effectiveness of the liaison program (school visits) 
in helping you? 

_very effective, __f airly effective, not effective, __not observed 

PLEASE CIRCLE THE APPROPRIATE NUMBER TO INDICATE YOUR RATING FOR EACH OF THE 
COMPONENTS OF EACH OF YOUR COURSES (please request a separate sheet for each) : 

1 2 3 4 5 

very strong fair weak very 
strong weak 

1. How would you rate the coverage 

of the subject matter? 1 2 3 4 5 

2. How would you rate the methods 

used in teaching the course? 1 2 3 4 5 

3. How closely were the tests related 

to the materials covered? 1 2 3 4 5 

4. In so far as you can tell at this 
point, how would you rate the grad- 
ing system used in this course? 1 2 3 4 5 

5. How would you rate your learn- 
ing in this course? 1 2 3 4 5 

6. Taking all factors into consi- 
deration, what would your rat- 
ing be for this course? 1 2 3 4 5 



Course/Dept . Number Section 



Social Security Number (optional) 
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ETSU STUDENT SURVEY 



The East Texas State University Bilingual Studies program is conductinq this 
cin bTLn3 to ° btAin ^°™tion about its academe program and hL it 
can be improved. We would appreciate your replies to these few Questions as 

ShT^S^ 6 feel freC to ^ SU ^ eStio ^ wSl help 

Thank you. Dr. Alonzo Sosa, Coordinator cJl. Si. (Soda 

GENERAL INFORMATION: 

l.a. I am currently taking one or more courses at ETSU. Yes No 

b. I am currently taking one or more courses at another university. Yes No. 

2 ' a ' tof (s^clrv^^ ° C ^ tion? teacher: ElBrentary__Secondary ; Acmdnistr- 
^or ispeciry) . ( Other (soecify) : — 

n jI ™ f* 6 J? J. teacher now, did you teach after leav ing ETSU? Yes N6 

c. If you taught, did you teach in a bilingual program? Yes No ~ ~ 

d. Did you teach ESL or a similar program? Yes__No_ — — 

3. Academic training achiever: 

a. Bachelors degree: Yes_Nq__ (b) If yes, at ETSU: or another university 

c. Masters degree: Yes__No_; (d) If yes, at ETSU? ~Er another universi^— 
e. Doctoral degree: Yes_No_; (f) if yes, at ETSUT or another universItV 
g. * only took a few courses at ETSU rather than a digree or certificate 
program J 3 w lwSk,c 

4. a. Do you hold the bilingual endorsement? Yes No • 

b. Did you qualify for it at ETSU? or at anotheFinstitutior? 

c. If you obtained any other certificate or endorsement from ETslT~please 
list it (them) : * 



EVALUATION INFORMATION: 

Please answer the following questions by circling a number on the scale that 
best describes your judgement about the program components listed: 1-verv weak 
2-weak, 3=fair, 4=strong, 5=very strong, 6=didnot participate /don • t kn^w/dolf not 
apply. Please use the consent line for exceptions or other special idSs 
you want to ccrrmunicate. 

». ««,., BEST COPY AVAILABLE 

b. Cogent _ 12^456 

6. a. Encrlish course (s) 1 ' . _ 

b. Carrrent 1 2 3 4 5 6 

7. a. Social studies/history course (s) ' \ , s ; = c 
b. Carrrent 1 * J 4 5 6 

S. a. Math/science course (s) " ■ 

b. Ccrrrent 



1 2 3 4 5 6 



9. a. Bilingual methods course (s) 

b. Comment 

1C. a. Other language arts methods course (s) 

b. Ccrrrent 



1 2 3 4 5 6 



1 2 3 4 5 6 



11. a. ESL methods course (s) 
b. Carrrent 

12. a. Social studies/multicultural irethods course (s] 
b. Ccnrrent 



9 

ERIC 



13. a. 


Course (s) on methods for other subjects 


1 2 3 4 5 6 


b. 


Carment 




14. a. 


Your endorsement/certificate program as a whole 


1 2 "3 4 £ 

J *i j O 


b. 


Corrment 




15. a. 


Your degree program as a whole 


12 3 4 5 6 


b. 


Corrment 




16 • £ • 


xii-LJi^ing odout: your tiou program as a whole, include 


.ng advising, acdemics, 




assistance, please give an overall rating. 


1 2 3 4 5 6 


b. 


Ccrrrvent 





Please fold so that the portion above is inside - covered up. Thank you for your 
helo. 



Fold here, please, so that the portion below is outside; staole or tape the edge, 

and rail. 



Prepaid Postage 



Office of Bilingual Studies 
East Texas State University 
Ccrmerce, Texas 7542S 
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